METHOD AND DEVICE FOR CONTROLLING A PLURALITY OF 
MANIPULATORS 

FIELD OF THE INVENTION 

The invention relates to a method and to a device for con- 
trolling a plurality of manipulators having a plurality of 
control units associated with said manipulators, so that 
each control unit controls at least one manipulator. 

BACKGROUND OF THE INVENTION 

For the manual movement of manipulators such as industrial 
robots, e.g. within the framework of robot teaching proc- 
esses, or when modifying software-supported control pro- 
grams on control units associated with the manipulators, 
nowadays use is generally made of portable and therefore 
flexibly usable operating equipment. The latter generally 
has operating and input elements such as control levers or 
keys and possibly also indicating or display elements and 
are connected by means of cables or through wireless commu- 
nication to a robot control unit. 

Such an operating device is required for each control unit, 
so that generally an individual operating device is used 
for each manipulator, because each manipulator also has its 
own control. Alternatively, it is known to provide a com- 
mon control for several manipulators, when only a common 
operating device is connected to the control. 

In the first mentioned alternative, it has proved disadvan- 
tageous when using a cable connection between the operating 
device and the control unit that due to the large number of 
operating devices used, there is a crossing and interlacing 
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of cables and consequently it is not readily possible for 
operating personnel to reliably associate the operating de- 
vices and manipulators, particularly if the latter are 
closely juxtaposed, as is the case in the car industry. 

For safety reasons the operating devices for manipulators, 
such as industrial robots, regularly have a consent or per- 
mission switch, which must be depressed in test operation 
in order to be able to move the particular robot. In ap- 
plications where several manipulators cooperate with one 
another, it has proved disadvantageous that then the per- 
mission switch must be simultaneously depressed on several 
operating devices, so that such an operation of cooperating 
robots is only possible when there are several operators. 

The aforementioned disadvantages are avoided in known con- 
trol systems, where a plurality of robots is connected to a 
common control. However, then the number of operable ro- 
bots is limited by the capacities of the individual control 
units. If the number of manipulators exceeds the number of 
manipulators connectable to a control, it is no longer pos- 
sible to move all the manipulators in a coordinated manner, 
which considerably limits the flexibility of such systems 
in use. 

The problem of the invention is, whilst avoiding the afore- 
mentioned disadvantages of the prior art, to provide a 
method and a system for controlling a plurality of manipu- 
lators, which permits an operation of a random number of 
manipulators, said number being independent of the capaci- 
ties of the individual control units and at the same time a 
coordinated movement of several manipulators is to be made 
possible, such as a planned influencing of individual ma- 
nipulators . 
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SUMMARY OF THE INVENTION 

In a method of the aforementioned type, the set problem is 
solved in that a single operating device accesses several 
control units. In a device of the aforementioned type the 
set problem is solved by a common operating device connect- 
able to at least one specific control unit for the opera- 
tion of the manipulators . 

The invention ensures a flexible control or operation of 
the manipulators . During the method according to the in- 
vention or within the scope of the device according to the 
invention, in the case of several control units, it is pos- 
sible e.g. during test operation for an operator to influ- 
ence directly movements of one or more manipulators by 
means of one operating device. According to a further de- 
velopment of the inventive method, on the operating device 
for a movement control of the particular manipulators are 
generated in a direct manner suitable control signals 
(movement -relevant signals) . 

According to a further development of the inventive device, 
the control units are in each case subdivided into areas 
set up for a real time and a non-real time operating system 
and preferably the real time areas of the control units are 
constructed for the processing of control signals 
(movement -relevant control signals) directly suitable for a 
movement control of the particular manipulators. In this 
connection, according to a further development of the in- 
ventive method, the movement -relevant control signals are 
directed via a first transmission device to an area of the 
associated control unit, which is constructed for a real 
time processing of movement -relevant control signals. 
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Additionally according to a further development of the in- 
ventive device, the non-real time areas of the control 
units are connected by means of a second transmission de- 
vice. In order to be able to control a plurality of ma- 
nipulators with a single common operating device, according 
to a further development a control unit, with which the op- 
erating device can be physically or logically connected, 
has in its non-real time area a terminal device for dis- 
playing operating surfaces of different control units. In a 
preferred further development, said control unit also has a 
detecting device for detecting the control unit controlling 
the selected manipulators. According to a preferred devel- 
opment, the inventive device also incorporates a path con- 
trol device on which it is possible to act through the de- 
tecting device, so that the movement -relevant control sig- 
nals can be directed by means of the first transmission de- 
vice to the control unit associated with the selected ma- 
nipulators . It is possible in this way to direct in tar- 
geted manner the control signals triggered by the common 
operating device to specific control units. In parallel to 
a transmission to the associated control unit, in the con- 
trol unit having the detecting device, according to the in- 
vention, there is preferably a directing of the control 
signals to the terminal device. 

According to a further development of the inventive method, 
further not directly movement -relevant control signals gen- 
erated by the operating device are exclusively directed to 
the terminal device. In the framework of the device ac- 
cording to the invention, it is also possible for all the 
control signals between the terminal device and an area of 
the associated control unit constructed for the processing 
of data in non-real time, such as an operating surface, to 
be communicatable by means of the second transmitting de- 
vice. 
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To enable an operator to directly control the manipulator 
to be operated, according to the method of the invention 
the operating device displays the operating surface of the 
control unit of the selected manipulator, the display pref- 
erably taking place graphically and the image information 
being transmitted in standard pixel data form. In order to 
transmit image information of the control unit associated 
with the selected manipulator to the operating device in as 
efficient a manner as possible, according to further devel- 
opments of the inventive method, image information data are 
digitally transmitted to the controls and such data are 
compressed prior to transmission. Preferably standard im- 
age data are transmitted not in pixel form, but merely as 
control instructions and are independently graphically dis- 
played by the operating device. 

To be able to stop the robot in the case of a loss of con- 
nection between the operating device and the manipulator or 
the associated control unit, according to a preferred de- 
velopment of the inventive method, the transmission of 
movement -relevant signals via the first transmitting device 
is controlled by a first monitoring device and in the case 
of a transmission interruption the monitoring device gener- 
ates a movement -relevant, e.g. a movement -preventing con- 
trol signal. Said control signal can be subsequently used 
for stopping the particular manipulator. 

It must also be prevented that the image data displayed on 
the operating device come from a first manipulator or its 
control, whereas the generated control signals are trans- 
mitted to another robot control. In order to ensure this, 
in a preferred development of the inventive device, display 
and control signals between the control units and the oper- 
ating device can be transmitted on a common data channel. 
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Alternatively, in the inventive method, image data and con- 
trol signals generated by the operating device are trans- 
mitted on different channels, but the function and target 
of the channels are controlled by a second opposite moni- 
toring device, which is constructed for monitoring a func- 
tion of a target of the data channels, so that it can be 
ensured that both channels are functioning and end at the 
same control unit. 

To allow a single operator to operate several manipulators 
with a single operating device, according to a particularly 
preferred development of the inventive device, there is a 
unigue association of the displayed operating surface and 
the selected manipulators. For this purpose the operating 
surface and the corresponding manipulator can have substan- 
tially identical, optically active markings. Within the 
scope of a further development of the inventive device, the 
manipulators in each case have optical and/or acoustic sig- 
nal generators, which are in each case constructed for 
emitting a signal at or during a selection of the particu- 
lar manipulator. Then, in conjunction with the inventive 
method, for identifying the selected manipulator an opti- 
cally active marking present on the given manipulator is 
displayed on the operating device or an acoustic and/or op- 
tical signal generator present on the particular manipula- 
tor is activated. In an alternative development of the in- 
ventive method, for identifying the selected manipulator a 
designation of the manipulator, such as a name is displayed 
on the operating device. 

In order to make clearly detectable the choice of a manipu- 
lator made by an operator on the operating device, on the 
manipulators or on the operating device are provided opti- 
cal and/or acoustic signal generators, so that the manipu- 
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lator linked with the operating device is indicated by an 
optical and/or acoustic signal generator. 

In order to permit the simultaneous movement of a plurality 
of robots when using the inventive control system, the cor- 
responding control information such as the depression of a 
permission key, operating mode, pending emergency stop, 
etc. must be simultaneously transmitted to all the manipu- 
lators. Thus, according to a further development of the in- 
vention, the control units of all the manipulators are in- 
terconnected by a safety transmitting device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Further characteristics and advantages of the invention can 
be gathered from the attached claims and the following de- 
scription of embodiments relative to the drawings, wherein 
show: 

Fig. 1 A diagrammatic overall view of an inventive 

device with a first connection possibility 
for a common operating device. 

Fig. 2 A block diagram showing the architecture of 

an inventive device according to fig. 1. 

Fig. 3 Another connection possibility for a common 

operating device to a device according to 
fig. 1. 

Fig. 4 A representation corresponding to fig. 1 in 

the case of a device with separate data 
channels . 
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Fig. 5 

Fig. 6 

Fig. 7 
Fig. 8 

Fig. 9 

Fig. 10 

Figs. 11a, 
lib 

Fig. 12 

Figs. 13a, 
13b 



A diagrammatic representation of a first 
selection possibility for a specific control 
unit through a common operating device. 

A diagrammatic representation of a second 
selection possibility of a specific control 
unit by a common operating device. 

A flow chart of a switching process between 
two specific control units. 

A flow chart of a boot process of the 
control unit to which the common operating 
device is connected. 

A flow chart for initiating the switching 
process • 

A flow chart of the switching process. 



Diagrammatic representations relative to the 
visualization of remote devices used during 
the inventive method. 

A visualization flow chart. 



Diagrammatic representations of association 
possibilities between the operating device 
and manipulator. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a plurality of manipulators, such as indus- 
trial robots 1.1-1.4, which are in each case connected to 
an associated control unit 2.1-2.4 for controlling the par- 
ticular robot. The control units 2.1-2.4 are intercon- 
nected by means of a real time data bus 3, e.g. Ethernet, 
Firewire, etc. for the planned addressing of each unit. In 
the embodiment shown a stationary monitoring device 4, e.g. 
a control station or computer for (remote) maintenance pur- 
poses is also connected to the data bus. 

The control units 2.1-2.4 are also connected by means of an 
" additional safety bus 5 by means of which safety-relevant 
signals can be simultaneously supplied to all the connected 
devices 2.1-2.4. 

Fig. 1 also shows a common operating device 6, which is 
connected to a random one of the control units, here unit 
2.3. Control unit 2.3 serves as a connection point, i.e. 
it makes available the supply voltage, the data connection, 
the image generation and the access to the safety bus 5 by 
means of which the operating device 6 is connected to all 
the control units 2.1-2.4. By means of the safety bus 5 
specific settings on the operating device 6, such as oper- 
ating mode, emergency stop, permission, drives on-off , act 
simultaneously on all the further connected control units 
2.1-2.4 or manipulators 1.1-1.4. The operating device 6 is 
also connected by means of a data bus 7 and a visualizing 
bus 8 to the control unit 2.3. 

By means of the data bus 7 inputs, e.g. key depressions of 
the operator of the operating device 6 are transmitted in 
real time to the control unit 2.3. There is a simultaneous 
securing of communication by a monitoring device (Watchdog; 
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fig. 2): .If the control unit 2.3 or operating device 6 are 
no longer transmitting data, either the operating device 6 
or the control unit 2.3 by means of the safety bus 5 trig- 
ger a movement stop for the connected control units 2.1-2.4 
or the manipulators 1.1-1.4. 

The control unit 2.3 receives the control signals generated 
at the operating device 6 and evaluates them in real time. 
Movement -relevant and therefore time-critical control sig- 
nals such as start, stop or manual movement keys are proc- 
essed with a higher priority than general, not directly 
movement-relevant control signals or operating keys in or- 
der to ensure a rapid reaction of the manipulators 1.1-1.4. 
~ Time-critical signals arise, e.g. on operating special 
movement keys on the operating device, so that movement- 
relevant control signals are generated. On releasing such 
a movement key, there is immediately a stoppage of the par- 
ticular manipulator 1.1-1.4. However, visualization data 
are not time-critical. If the image or picture composition 
on the operating device 6 to some extent takes place with a 
time delay, this has no negative effects with regards to 
manipulator operation. 

The control unit 2.3 also provides a connection between the 
operating device 6 and data bus 3 . Inputs at the operating 
device 6 are directed in targeted manner from the control 
unit 2.3 to another control unit 2.1, 2.2, 2.4 associated 
with a manipulator 1.1-1.4 to be operated. Higher prior- 
ity, movement-relevant control signals are transmitted with 
an individual transmission protocol, so as on the one hand 
to guarantee the real time nature of the transmission and 
on the other to ensure that a monitoring device 4 cannot 
move a manipulator 1.1-1.4. The connections between the 
control units via the data bus 3 are also secured by a 
monitoring device (Watchdog; fig. 2) . 
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Lower priority control signals, e.g. normal keys such as 
letters and numbers, are transmitted by means of a standard 
protocol, e.g. RDP (Remote Desktop) . This guarantees that 
a monitoring device 4 can be used in order to perform oper- 
ating actions on the control units 2.1-2.4, e.g. in order 
to program or configure the same. In this case a movement 
of the manipulators 1.1-1.4 is impossible. 

In order to be able to also operate a "remote" control unit 
2.1, 2.2, 2.4 to which the operating device 6 is not con- 
nected by means of the latter, which is the aim and purpose 
of the present invention, the operating device 6 must also 
be able to display the remote operating surface BOF of the 
remote control unit. This is implemented by control unit 
2.3, i.e. the particular control unit to which the operat- 
ing device 6 is connected (cf . fig. 2) . All the connected 
control units 2.1-2.4 make available to the data bus 3 the 
display of their operating surface BOF by means of a stan- 
dardized protocol such as RDP. By means of the data bus 3, 
the control unit 2.3 recalls the corresponding data, par- 
ticularly image data, converts the same and directs them 
via the visualizing bus 8 to the operating device 6. 
Through the use of a standard format such as RDP, it is 
also possible for the monitoring device 4 to access the op- 
erating surface BOF of the individual control units 2.1- 
2.4. 

The visualization data to be transmitted to the operating 
device 6 are low priority signals, in the manner described 
hereinbefore. 

The general inventive concept concerning signal and image 
data transmission will be explained in greater detail here- 
inafter relative to fig. 2. 
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Fig. 2 shows in broken line form three control units ac- 
cording to fig. 1. The left-hand control unit 2.3 in fig. 
2 is the control unit to which the common operating device 
6 is connected via the data bus 3, whereas the two other 
control units in each case represent one of the further 
control units 2.1, 2.2, 2.4 of fig. 1. In the construction 
shown in fig. 2, the common operating device 6 has an input 
unit 6.1, optionally with a keyboard and further operating, 
indicating and display elements. 

Data bus 3 is used for transmitting higher priority data, 
e.g. movement -relevant control signals, whilst an addi- 
~ tional bus 3 ' ensures the transmission of lower priority 
data. As shown in fig. 2, buses 3 and 3' can be physically 
separated or, as stated relative to fig. 1, can be imple- 
mented by means of different transmission protocols. 

As is also shown in fig. 2, the control units 2.1-2.4 are 
subdivided into an area RT (Real Time) , which is con- 
structed for implementing real time operating systems such 
as VxWorks, and a second area NRT (Non Real Time) con- 
structed for implementing a non-real time operating system 
such as Windows. The control unit 2.3 also has a special 
driver 2.3a for the common operating device 6. In the same 
way as the driver 2.3a of control unit 2.3, the further 
control units 2.1, 2.2, 2.4 have operating device emulators 
2 .Xa. 

In addition, in its RT area, the control unit 2.3 has in 
conjunction with the data bus 3 a monitoring device 2.3b 
(Watchdog), a path control device 2.3c and a processing de- 
vice 2.3d for movement- relevant control signals. In its 
non-real time area NRT the control unit 2.3 incorporates a 
detecting device 2.3e, a queue 2.3f for input signals, e.g. 
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keyboard signals, as well as a terminal device 2.3g for 
displaying its own or remote operating surfaces BOF or TCI, 
TC2 . 

The remote control units 2.1, 2.2, 2.4, according to fig. 
2, comprise in their RT area in each case a processing de- 
vice 2.Xd for movement -relevant signals and in the NRT area 
in each case a queue 2.Xf, a reader 2.Xh for reading the 
input signals from the non-real time bus 3 ' and terminal 
serv er programs TS1, TS2 for implementing an operating sur- 
face BOF on the corresponding control unit 2.1, 2.2, 2.4. 

The control unit 2.3 also comprises a switching device 
2.3i, which receives (keyboard) signals from the queue 2.3f 
and acts on the terminal device 2.3g for the selection of 
an active display area TCI, TC2 , BOF. A selecting device 
2.3k is directly connected to the verification device 6.3 
of the operating device 6. 

The transmission and processing of real time data, such as 
movement -relevant control signals, takes place in RT areas 
of control units 2.1-2.4, whereas in NRT areas there is 
only a transmission or processing of data requiring no real 
time treatment, e.g. visualization data. 

The driver 2.3a of control unit 2.3 communicates by means 
of a CAN protocol (Controller Area Network protocol) with 
the operating device 6 . Unlike in the case of known meth- 
ods or devices, the control signals generated by the oper- 
ating device 6 e.g. by depressing keys, are not directly 
directed to the RT area of the control unit 2.3 or control 
units 2.1-2.4, but instead are, according to the invention, 
subdivided into three groups: 
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Signals generated by the operating device 6 are transmitted 
by driver 2.3a to the queue 2.3f in the NRT area of the 
control unit 2.3. Thus, in the NRT area the signals are 
available to all programs, e.g. terminal client programs 
TCI, TC2 . They are used for displaying remote operating 
surfaces and are consequently as a result of their link 
with the terminal client DLLs TC-DLL (Dynamic Link Librar- 
ies) able to intercept special control signals, e.g. selec- 
tion signals for specific manipulators and/or control units 
and transmit them by means of the non-real time bus 3 ' to 
the corresponding remote control unit 2.1, 2.2, 2.4. When 
a terminal client program receives input signals, it trans- 
mits them to the corresponding terminal server TS1, TS2 on 
- the corresponding control unit 2.1, 2.2, 2.4 on which runs 
the corresponding operating surface BOF of the remote con- 
trol unit 2.1, 2.2, 2.4. 

If an operator generates on operating device 6 movement- 
relevant signals, e.g. by depressing special movement keys, 
the control unit 2.3 transmits said movement -relevant sig- 
nals in parallel to the indicated transmission in the NRT 
area of the control unit 2.3 to the processing device 2.3d, 
2.Xd in the RT area of the device, i.e. to the processing 
device of the selected control. The addressing of the cor- 
rect processing device 2.3d, 2.Xd takes place by means of 
the TCP/IP address of the associated control unit 2.1-2.4. 
Signal processing in the RT area of the device takes place 
in conventional manner for the movement control of the ma- 
nipulators 1.1-1.4 (fig. 1). The transmission to the cor- 
responding operating surface BOF of the control unit 2.3 or 
units 2.1, 2.2, 2.4 takes place by means of the queue 2.3f 
or the bus 3' and the corresponding terminal server TS1, 
TS2. 
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The processing device 2.3d, 2.Xd differentiates between the 
control unit 2.3 or the remote control units 2.1, 2.2, 2.4. 
Only in the case when the processing device 2.3d of control 
unit 2.3 receives a movement -relevant signal, does it di- 
rect the same in the above-described manner to the NRT area 
of the selected control unit. The processing devices 2.Xd 
of the remote control units 2.1, 2.2, 2.4 do not direct the 
signals to the NRT area of the corresponding control unit 
2.1, 2.2, 2.4. This prevents the control unit from receiv- 
ing the same control signals in two ways, namely via the 
terminal server and the processing unit, which could lead 
to control conflicts, i.e. in control units 2.1, 2.2, 2.4 
there is no double signal transmission between the RT area 
- and the NRT area of the particular control unit. 

If an operating device 6 generates a selection or switching 
signal, e.g. by depressing one or more selected keys, the 
driver 2.3a transmits a signal to the switching device 
2.3i. This generally software-constructed device jumps 
backwards and forwards between the local operating surface 
BOF of the control 2.3 and optionally further terminal cli- 
ents TCI, TC2 represented in the terminal device 2.3g and 
which display the operating surfaces of the other control 
units 2.1, 2.2, 2.4 (figs. 5, 6). If the switching device 
2.3i jumps to another terminal client TCI, TC2 or the local 
operating surface BOF, the corresponding application comes 
in the focus of the NRT operating system of control unit 
2.3. Such a focus shift is detected by the detecting de- 
vice 2.3e, which informs the driver 2.3a of the focus shift 
and transmits an IP address of the particular RT area of 
the associated control unit 2.1-2.4 or the corresponding 
processing device 2.3d, 2.Xd to the path control device 
2.3c. In accordance with the path control device 2.3c, the 
driver 2.3a "uncouples" from the RT area of the previously 
active control unit 2.1-2.4 and is transmission-linked with 



the RT area of the newly selected control unit 2.1-2.4 cor- 
responding to said IP address. 

In this way an operator can even use standardized input de- 
vices, such as a conventional keyboard or mouse, in order 
to jump backwards and forwards between the applications, 
i.e. the terminal clients TCI, TC2 and the local operating 
surface BOF, without there being any risk of one specific 
operating surface being displayed, whereas another operat- 
ing surface or another control unit has been selected: The 
system is synchronized in accordance with the active window 
(application program TCI, TC2 , BOF in the focus of the NRT 
operating system of the master control 2.3) and not by 
means of key depression (signal generation) on operating 
device 6 . 

In normal operation each control unit 2.1-2.4 checks 
whether a common operating device 6 is connected thereto 
before enabling drive units of an associated manipulator 
1.1-1.4 (fig. 1). As the control units 2.1, 2.2, 2.4 are 
not directly connected to an operating device 6, it is nec- 
essary to eliminate such safety precautions. This function 
is fulfilled by operating device emulators 2.Xa of control 
units 2.1, 2.2, 2.4, which determine the presence of a com- 
mon operating device 6 at control unit 2.3 and transmit 
corresponding control signals for the elimination of the 
indicated protective precautions on the control unit 2.1, 
2.2, 2.4. 

A safety monitoring of the selection of control units or 
manipulators implemented by the user is performed according 
to the invention on both a hardware and software basis. 
The hardware component in particular comprises the safety 
bus 5 . 
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The construction of the inventive system corresponding to 
fig. 1 is essentially shown again in fig. 3 and is provided 
with manipulators 1.1-1.4 and associated control units, 
2.1-2.4, which are linked by means of a data bus 3 and a 
safety bus 5. Here again a stationary monitoring device 4 
is provided on the data bus. Unlike in fig. 1, in the em- 
bodiment of fig. 3 a common operating device 6 is directly 
connected to the data bus 3 and safety bus 5. In this case 
the operating device 6 directly accesses via the bus one of 
the control units 2.1-2.4. Such a construction presupposes 
a more complex operating device 6, because the latter must 
implement the different protocols for the visualization of 
the terminal device of the master control and for actual 
operation. In addition, the operating device 6 must inde- 
pendently implement the direct link with the data bus 3 . 

The development of the inventive system shown in fig. 4 
also essentially corresponds to the embodiment of fig. 1, 
but the control units 2.1-2.4, much as in fig. 2, communi- 
cate via two physically separate data buses 3, 3', instead 
of via a common data bus using two different protocols. 
The data buses 3, 3' thus separate time-critical, e.g. di- 
rectly movement -relevant data from physical data of a not 
time-critical nature and transmit the same on separate 
channels. The use of two separate data buses 3, 3' conse- 
quently avoids the software control of priorities in the 
case of data traffic via one bus. 

Fig. 4 also shows a monitoring device 3" constructed for 
monitoring the operability and target of the separate data 
channels to ensure that an operator operates the manipula- 
tor whose operating surface he sees . 

The basic distinction as to which data are time-critical is 
either made by the operating device 6 (in the case of a de- 
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vice directly connected to the bus, cf . fig. 3) or the con- 
trol unit 2.3 to which the operating device 6 is connected 
(figs . 1, 4) . 

Figs. 5 and 6 illustrate the selection of a specific con- 
trol unit 2.1-2.4 by an operator using the operating device 
6 . For this purpose the operator depresses on the operat- 
ing device 6 a special key or key combination, so that a 
selection signal is generated. According to fig. 5, this 
results in operation changing from the present control unit 
to the next control unit (indicated by arrows P, P' in fig. 
5) . The change is tantamount to a focus change in the ter- 
minal device 2.3g of control unit 2.3 (cf. fig. 2). Thus, 
an operator is very rapidly able to change from one control 
unit to the next. The change takes place internally by the 
cyclic processing or running through of lists, so that the 
switching order is always the same. If one of the control 
units, such as e.g. unit 2.3 in fig. 5, is not available, 
it is skipped during selection (broken lines P') and the 
operating device by means of the control unit 2.1 directly 
accesses control unit 2.4 (arrow P M ). Such a change proce- 
dure speeds up selection, particularly in smaller installa- 
tions with few control units. 

As an alternative, fig. 6 shows the selection of control 
units by planned selection. In this case the operator 
calls up a dialogue by means of the operating device 6 and 
in which are listed all available control units. Thus, by 
planned selection it is possible to jump directly to a spe- 
cific unit and this is particularly appropriate in larger 
installations . 

Fig. 7 shows a flow chart of a switching process between 
control units. After starting the switching process in 
step Sll, in step S12 an inquiry is made as to whether the 
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particular manipulators are at present moved in an auto- 
matic mode. The switching process is dependent on the op- 
erating mode. This is e.g. intended to make it possible in 
the automatic mode to change between control units without 
stopping a manipulator, e.g. in order to inspect outputs of 
a specific control device. The manipulators move autono- 
mously in the automatic mode, so that a switching to an- 
other control does not lead to a control loss. 

If the system is not in the automatic mode, the existing 
manipulator is stopped (step S13) . If the installation is 
not in the automatic mode or a manual operation is superim- 
posed in the automatic mode (inquiry in step S12 1 ) , it is 
possible for an operator to be moving and switching a ma- 
nipulator during movement, so that control regarding the 
particular manipulator is lost, because according to the 
invention operating processes act on another control unit 
following switching. Therefore the manually moved manipu- 
lator must definitely be stopped prior to switching (step 
S13) . 

Independently of the operating mode a state of the input 
devices (keys) on the operating device must be set at "not 
depressed" prior to switching so as to prevent the instal- 
lation being stopped (step S14) . The depression of a key 
on the operating device activates the monitoring device 
2.3b (Watchdog; fig. 2). The Watchdog is deactivated if no 
key is now depressed on the operating device. So that the 
Watchdog does not respond on switching, it is initially 
necessary to transmit the information "no key now de- 
pressed" (step S14) . Otherwise the Watchdog reacts to the 
switching in the same way as to a loss of the connection in 
the case of pending control signals. Only after the stop- 
ping of the manipulator and the resetting of the key state 
is it possible to close the connection to the particular 
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manipulator (step S15) and produce a connection to another 
manipulator (step S16) . 

Fig. 8 shows a flow chart of the boot process of the con- 
trol unit to which the common operating device is con- 
nected. After the particular control unit (figs. 1, 2 and 
4: control unit 2.3) has booted the operating system (step 
S21) , it attempts to make connections with the other con- 
trol units 2.1, 2.2, 2.4. This takes place with the aid of 
a stored list, e.g. an address list. The control unit 2.3 
processes this list in order and in step S22 checks whether 
a further control unit 2.1, 2.2, 2.4 can respond via the 
bus. If this is the case and there is no connection to 
such a control unit, a connection is built up and "parked" 
(steps S23, S24), i.e. the connection exists and no or only 
few data are exchanged. If the corresponding, other con- 
trol unit cannot be reached via the bus, a check is made as 
to whether the control unit was available beforehand (step 
S25) . In this case, in step S26, an existing, parked con- 
nection is closed and the next control in the list is 
checked for availability. Then the process is repeated cy- 
clically starting with step S22. 

With the aid of this method it is possible to switch on and 
off the control units in a random order without the opera- 
tor losing the possibility of switching to a specific con- 
trol unit. Also in the case of network errors the control 
units are quickly available again to the operator via the 
operating device. 

By means of a flow chart, fig. 9 makes clear the initiating 
of a switching process when there are parked connections. 
They are linked with an application for displaying 
(visualizing) a remote operating surface BOF (cf. fig. 2). 
For the remote operating surface the BOF of this applica- 
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tion (terminal device, fig. 2) makes available to the mas- 
ter control a window in the NRT area. For the window which 
has the focus (at the front under Windows on the desktop) 
and therefore seen by the operator on the master control or 
the operating device, the connection must be activated. 

The operator has several possibilities for making the con- 
nection with another control unit: There can be a sudden 
or planned selection on the operating device (step S31, cf . 
figs. 5 and 6) or use can be made of a specific, conven- 
tional operating system function for switching to a spe- 
cific window, e.g. depressing "Alt" + "Tab" under Windows 
(step S31') . As also in the latter case the switching to 
- another control unit must function, according to the inven- 
tion switching is not linked with a specific key combina- 
tion, but instead with the focus on a specific window es- 
tablished in step S32. By means of the focussed window the 
master control firstly checks whether it is the display of 
a remote operating surface/control unit (step S33) . If 
this is the case and this window displays another control 
unit to that which is at the moment displayed, then in step 
35 the switching process is initiated. Otherwise (step 
S34) the present connection is maintained. 

Fig. 10 illustrates the sequence of the switching process, 
step S41 following on to the already explained step 35 
(fig. 9) and firstly a connection is made to the selected 
control unit. Then, by means of the non-real time data 
channel 3' (fig. 4) or by means of the corresponding proto- 
col, a connection is made to the remote control unit (step 
S42) . If the connection can be made (step S43), an attempt 
is made in step S44 to produce the real time data connec- 
tion (data bus 3, fig. 4). A check is then made in step 
S45 as to whether both data connections end at the same re- 
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mote control unit. Several methods can be considered for 
this purpose: 

Checking by means of stored lists whether the target 
addresses end at the same control unit. 

Transmitting a randomly selected code on one data 
channel, which is received by the remote station and 
sent back on the other data channel. If the 
originally transmitting control unit receives its code 
back on the other channel within a short time, then 
both data channels are connected to the same control 
unit . 

If the data channels do not end at the same control unit, 
then in step S46 blocking takes place of all the movement 
functions (functions which are based on signals transmitted 
via the real time data channel) and an error message is 
generated via the non-real time data channel (step S47) . 
Then and as in the case of an affirmed inquiry S45, in step 
S48 operation is released to enable the operator to work 
with the control unit. 

Figs. 11a and lib illustrate the visualization of a remote 
control unit 2.1, 2.2, 2.4 (fig. 2) by control unit 2.3 or 
the common operating device 6. Visualization takes place 
on operating device 6 or the terminal device 2.3g of master 
control 2.3 with the aid of a special program, e.g. Micro- 
soft Remote Desktop. This program represents the complete 
screen or complete operating surface of the remote control 
unit and is independent of the software running on the re- 
mote device. Thus, different devices can be used, provided 
that they support this specific program. In principle, two 
procedures are possible for implementing visualization: 
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In fig. 11a, for each remote control unit 2.1, 2.2 a con- 
nection Vi, V 2 is built up by means of the non-real time 
data bus 3' (fig. 2) and is permanently maintained, i.e. 
the remote control units 2.1, 2.2 are represented as a 
stack of superimposed windows on the operating device 6 or 
6.1 and/or on the terminal device 2.3g of control unit 2.3. 
This design has the advantage that the switching times are 
very short, because no new connections have to be formed at 
the switching time. However, the connections must be per- 
manently monitored in order to detect dead connections, 
such as e.g. arise by the disconnection of a remote control 
unit 2.1, 2.2 and if necessary build them up again in the 
background . 

Fig. lib shows an alternative construction in which only 
one visualization connection V is constructed. On switch- 
ing the present connection V is dismantled and a new con- 
nection V formed. However, this variant requires longer 
switching times, but does not need the aforementioned con- 
nection monitoring. 

Fig. 12 shows the processing steps taking place up to the 
display on the operating device 6 for the image data to be 
displayed. A random application, e.g. the aforementioned 
Microsoft Remote Desktop, transfers display instructions to 
a corresponding interface of the operating system, e.g. 
Windows in the case of the NRT area (fig. 2) of a control 
unit 2.1-2.4. The display instructions can e.g. be the 
graphic display of a switching surface, a line, etc. The 
operating system prepares these commands, in that it sends 
detailed instructions to the graphic card driver, here e.g. 
the display of a small box, a background colour, an in- 
scription, etc. The graphic card driver converts these in- 
formation into pixel information and enters them in the 
graphic card (step S51-S54) . 
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A plurality of available programs for representing remote 
computers (control units) scan situations on the graphic 
driver plane first (step S53), i.e. a very large number of 
pixel information are transmitted, which inflate the data 
volume and delay data transmission. In the system accord- 
ing to the invention the data are intercepted on the 
graphic interface plane of the operating system (step S52) 
and transmitted by Ethernet to the target system (master 
control 2.3) with interposed data compression and decom- 
pression steps (steps S55 and S56) . This drastically re- 
duces the data volume, because for the same transmission 
rate per time unit more commands are transmitted than pixel 
- information. Pixel information transmission is only neces- 
sary for displaying images. Steps S55 and S56 permit the 
operation of the system using a slow modem connection. 

The receiving station (terminal device 2.3g and/or operat- 
ing device 6) receives the data (step S57) which are op- 
tionally transformed if e.g. the depth of colour or resolu- 
tion of the transmitting and receiving system differ. The 
data are then displayed in the conventional manner by means 
of the operating system interface, graphic card driver and 
graphic card (steps S58-S60) . It is fundamentally possible 
according to the invention to operate the control units 
without graphic cards if the visualization is completely 
taken over by the operating device. At least for diagnos- 
tic purposes, graphic cards are still helpful in the con- 
trols . 

In order to allow a safe operation of several control units 
with a common operating device, there must be an operator- 
clear association between the operating device and control 
unit or manipulator, in the manner shown in figs. 13a and 
13b. 
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According to fig. 13a each manipulator is marked in an op- 
tically effective manner, e.g. by the application of col- 
oured strips. The operating surface, as displayed accord- 
ing to the invention on the common operating device 6 or on 
its input and display unit 6.1, reflects the marking of the 
manipulator with which it is instantaneously connected. 
This presupposes that the markings Mi, M 2 , M 3 of the manipu- 
lators 1.1, 1.2, 1.3 are matched to the software configura- 
tion of the not shown control unit. In place of a coloured 
marking it is also possible to use a random symbol which is 
used as a background for the operating surface displayed on 
the operating device 6 . 

Fig. 13b shows another, additionally or alternatively us- 
able identification possibility for the manipulators 1.1- 
1.3. Each manipulator 1.1-1.3 has a signal generator S, 
e.g. a lamp or a LED strip. 

If the operator selects on operating device 6 a not shown 
control unit, then the corresponding signal generator S 
lights up. However, the signal generator S can also be an 
acoustic signal generator or a combined acoustic-optical 
signal generator. Such a design has the advantage that no 
device has to be matched to an externally applied marking, 
so that a faulty configuration is largely prevented. 



